Intermittent relaxation in hierarchical energy landscapes 
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We numerically simulate a thermalization process in an energy landscape with hierarchically 
organized metastable states. The initial configuration is chosen to have a large energy excess, relative 
to the thermal equilibrium value at the running temperature. We show that the initial energy surplus 
is dissipated in a series of intermittent bursts, or quakes, whose rate decreases as the inverse of the 
age of the system. In addition, one observes energy fluctuations with a zero centered Gaussian 
distribution. These pertain to the pseudo equilibrium dynamics within a single metastable state, 
and do not contribute to the energy dissipation. The derivative of the thermal energy with respect 
to the logarithm of time is asymptotically constant, and comprises a temperature independent part, 
and a part with an Arrhenius temperature dependence. The findings closely mirror recent numerical 
simulation results obtained for microscopic glassy models. For these models, record-sized energy 
fluctuations have been claimed to trigger intermittent events during low temperature thermalization. 
In the present model record-sized fluctuations are by construction needed to trigger changes from 
one metastable state to another. This property thus suffices to explain the statistical property of 
intermittent energy flow in complex metastable systems. 

PACS numbers: 05.40.-a,65.60.+a 



I. INTRODUCTION 

Many characteristics of low temperature glassy dynam- 
ics are only weakly related to details of the microscopic 
interactions. Aging processes, for example, gencrically 
follow a change of an external parameter, e.g. a tem- 
perature quench. In experimental glassy systems a se- 
quence of large, so-called intermittent, configurational 
re-arrangements can be observed, which generate non- 
Gaussian tails in the Probability Density Function (PDF) 
of configurational probes [TJ [H El [H [SJ [5] • In microscopic 
model systems [7J [5] , the PDF of the energy fluctuations 
following a thermal quench also features a zero centered 
Gaussian and an exponential tail which covers large neg- 
ative changes. The former describes pseudo-equilibrium 
fluctuations and the latter is related to shifts between 
different metastable attractors. These and other features 
have been recently analyzed using an Edwards- Anderson 
spin glass model [7J, and an even simpler Ising model 
with four spin plaquette interactions jS] , which is known 
to possess central features of glassiness, e.g. a metastable 
super-cooled phase and an aging phase [TU1 E] ■ For both 
models, the rate of intermittent energy flow out of the 
system was found to fall off with the reciprocal of the 
system age. For the plaquette model, the temperature 
dependence of the rate was also analyzed in detail. 

The above aging properties can be understood using 
the idea that the attractors dynamically selected during 
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the process are marginally stable [TU [T3] . The so-called 
record dynamics scenario [Jj [13] then links the intermit- 
tent events, or quakes, to record-sized energy fluctuations 
occurring within thermalized local domains. Record fluc- 
tuations are not associated to a definite scale. For this 
reason alone, they will not lead to observable effects, un- 
less the energy landscape supporting the fluctuations is 
self-similar under a change of scale. Conversely, within 
a self-similar energy landscape, record-sized fluctuations 
are required to induce attractor changes. 

Simple hierarchical models of configuration space are 
already known to explain many facets of complex relax- 
ation [HJ ESI [161 El [18j HI]. In these mesoscopic de- 
scriptions, the configuration space of a physical system 
is coarse grained into a graph, whose nodes represent 
lumped sets of microscopic configurations with similar 
energies. Each node is thus simply characterized by its 
energy, i.e. the typical energy of its constituents, and by 
a degeneracy, i.e. the number of its constituents. Lump- 
ing is physically reasonable if the microscopic configu- 
rations lumped into the same node are able to reach a 
state of local thermal equilibrium on a time scale short 
compared to the time it takes to access configurations 
belonging to other nodes. Reference [18, provides an ex- 
ample where the lumping is explicitly carried out start- 
ing with a microscopic model. Connections between dif- 
ferent nodes represent possible dynamical pathways. In 
tree models, the connectivity is at the lowest level pos- 
sible for a connected configuration space. The unique 
path between two arbitrary nodes represents the domi- 
nant path in the original dynamical problem, i.e., typi- 
cally for thermal dynamics, the path through the low- 
est possible energy barrier. In the tree graph shown 
in figure [T] the vertical axis represents the energy, and 



2 



a hierarchy of barriers of different sizes is present. By 
construction larger and larger barriers must be overcome 
starting from one of the bottom nodes in order to ac- 
cess larger sets of states. Correspondingly, any sub-tree 
contains a number of lesser sub-trees characterized by 
smaller barriers. Also note that the energy minima have 
different energies and represent physically different meta- 
stable configurations. This inequivalence was introduced 
in the context of the so-called LS tree model [2U] of 
which figure [l] shows a generalization. The LS model's 
scale invariance is restricted to a discrete set of energy 
re-scalings due to the presence of only two 'elementary' 
energy scales, i.e. the energy differences L and S between 
neighboring nodes. To approach full re-scaling symmetry, 
the present study considers a randomized version of the 
model. While exact analytical results are then no longer 
possible, the randomized model still offers a strikingly 
simple and general conceptualization of a highly complex 
relaxation behavior. In particular, only record-sized en- 
ergy fluctuations can induce transitions out of a sub-tree 
into a larger subtree containing states of lower energy. 
Comparing the statistics of intermittent energy flow in a 
hierarchically structured energy landscape with the cor- 
responding properties of microscopic models provides a 
direct check of whether record-sized energy fluctuations 
indeed are the main mechanism for thermal relaxation in 
complex systems. 

In this article, energy traces are obtained from isother- 
mal simulations of an ensemble of randomized LS model 
aging after a thermal quench. The energy fluctuations are 
treated as time-resolved calorimetry data. Their proba- 
bility density function (PDF) shows the fingerprints of 
intermittent heat flow. The form of the local density 
of states of the attractors is extracted from the Gaussian 
part of the fluctuations, and the rate of energy flow is ex- 
tracted from the tail. The information is analyzed math- 
ematically and related to the known geometrical proper- 
ties of the model. 



II. MODIFIED LS-TREE ENSEMBLES 

In spatially extended systems with short range interac- 
tions, one expects thermalization to occur independently 
within a number of slowly growing domains or clusters of 
neighboring degrees of freedom. The configuration space 
of the full systems correspondingly factorizes into a prod- 
uct of configuration spaces, each term belonging to a sin- 
gle domain. Domains are expected to have a hierarchical 
organization, which, in the present context, is rendered 
by the modified LS tree described below. 

The randomized LS model used in the simulations can 
be pictured as an upward rooted tree with the vertical 
scale representing the energy as shown in figure [T] The 
n'th level of the tree comprises all the nodes connected to 
the root by precisely n edges, with n = 0, . . . , N. With 
the exception of the 'bottom' level with index n = N . 
each node is connected to two 'daughters' of lower en- 
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FIG. 1: The randomized LS tree used as model energy land- 
scape in the simulations. Contrary to previous LS tree setups 
the L and S branches are not of equal length for the whole 
tree but level dependent. This extension leads to a diversifica- 
tion of the time scales present within the tree and thus breaks 
unphysical logarithmic oscillations in the energy decay. 

ergy by a 'Longer' and a 'Shorter' edge. The modifica- 
tion of the original model [HE HD] consists in choosing, 
independently for each level, new random values of L 
and S, as discussed further below. Accordingly, the en- 
ergy differences along the 'Longer' and 'Shorter' edges are 
AE = L n and AE — S n for each level n. The above pro- 
cedure removes the oscillation on a logarithmic timescale 
characteristic of a regular tree, concomitantly decreasing 
the energy scale corresponding to the smallest barrier in 
the system. Each node represents a lumped set of config- 
urations and hence possesses a degeneracy. In the model, 
the degeneracy of a node equals the sum of the degen- 
eracies if its L n and S n daughters, each multiplied by 
a factor n Ln and K Sn , respectively. Bottom nodes are 
not degenerate. With this prescription, the overall de- 
generacy of the model increases in a nearly exponential 
fashion, as the level index increases from the bottom. A 
list of values 

£ = {23- 1 : i = 0...19} . (1) 

describes the possible energy differences. For each level 
of the tree, two values are drawn independently and with 
uniform probability from the list. They may be equal, 
and are assigned to the respective L and S branches, 
ensuring that L > S. 

Thermal relaxation is modeled as hopping between 
neighboring nodes, with up and down rates defined by: 

Lup.j — fj^j^ ^ Fdowiijj — fj , (2) 

where the index j e {L n ,S n } labels L- and 5-edges at 
level n. The hopping rates obey the detailed balance 
condition T (x , y) P cq (y) — T(y,x)P eci (x), where the equi- 
librium distribution is the Boltzmann distribution. So- 
called kinetic factors fj are introduced to control the re- 
laxation rate along each edge. Factors independent of 
j entail a trivial rescaling of the (arbitrary) time unit. 
In contrast, non-uniform factors considerably modify the 
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dynamics on short time scales after a thermal quench 
[21) . E.g. choosing fg n ^> favors downward transi- 
tions along the S edges, ensuring that an initial quench 
from the top node preferably ends near the shallowest 
metastable minimum. We achieve the same in a more 
ad hoc fashion, by choosing the highest lying and most 
shallow local energy minimum as the initial state for the 
aging dynamics. 



III. THE DYNAMICS 

The dynamical evolution of a single tree is studied us- 
ing a rejectionless continuous time Monte Carlo Method 
[22j . which operates with an intrinsic time variable t, ini- 
tially set to zero. The following three steps are iterated: 
for the current node, the possible transitions according 
to ([2]) are considered. In general one upward and two 
downward transitions are available, except for the bot- 
tom states and the top state, which have no downward, 
respectively upward transitions. Among the neighbors to 
the current node, one is chosen with probability equal to 
the transition rate along the corresponding edge, divided 
by the sum of all rates out of the current node. A random 
waiting time is then drawn from an exponential distribu- 
tion with average equal to the reciprocal of the transition 
rate. This waiting time is then added to the global time, 
and the position of the walker is finally updated. 

Each tree in the ensemble is updated independently as 
described above. The result is an ensemble of time se- 
ries, each describing the history of energy fluctuations of 
one member of the ensemble. The time series describ- 
ing the total energy of the ensemble is then obtained by 
interweaving the time scries pertaining to each tree into 
a single data stream ordered by increasing values of the 
time variable. 

In the following, the symbol t stands for the system 
age, i.e. the time elapsed since the beginning of the sim- 
ulation. The symbol t w is the age of the system when 
data collection for the fluctuation PDF begins. Energy 
fluctuations are energy differences over a time interval 
St < t w . 



IV. ENERGY TRANSFER STATISTICS 

Our results are based on an ensemble of 2000 trees of 
height N = 12, with 5000 independent runs on each tree. 
The model is set up with degeneracy growth parameters 
k l = k s = 2.20 and kinetic factors Jl = 0.25 and fs = 
1.00. The latter of these values would generally carry 
units. However, the choice of the units does not affect the 
results so they can be considered as being arbitrary here 
as well as in the figures showing the numerical results. 
The data pertain to systems initially quenched into the 
shallowest of the available minima, i.e. the minimum 
connected to the top node by a series of S links. 



t w = 1000 
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FIG. 2: The PDF of the amounts of energy exchanged be- 
tween system and thermal bath within the time St = 100. 
Negative values represent an energy outflow, while positive 
values represent an energy inflow. The data are taken for four 
logarithmic equidistant times in the interval t = [10 3 . . . 10 6 ]. 
The inset (taken from [5]) shows an analogous figure obtained 
for simulation of a microscopic glassy model with plaquette 
interaction. 

The PDF of the amount of energy exchanged within a 
time interval St at system age t w + k St 

AE = E(t w + k St) - E(t w + (k-l)5t) (3) 

is collected over k — 1 ... 100 time intervals using St — 
1 and starting at different values of t w , in the range 
10 3 ...10 5 . The zero centered Gaussian peak, flanked 
on the left by an exponential tail seen in figure [2] is the 
characteristic signature of intermittency. When k and St 
are kept fixed, the relative weight of the intermittent tail 
decreases with increasing t w . The width of the Gaus- 
sian fluctuations is independent of k and St. We can 
then conclude that the fluctuations are (pseudo) equi- 
librium energy fluctuations within partially equilibrated 
subtrees. Clearly then, as the Gaussian fluctuations do 
not contribute to the net energy flow, the latter is carried 
exclusively by the tail of the distribution, which pertains 
to intermittent quakes. 

The decay of the average energy is shown in figure [3] 
After an initial transient stretching to approximately t = 
200, the energy decreases in time in a logarithmic fashion: 

E(t,T) = -a(T) ln(t)+C . (4) 

In this model, a quake occurs when the lowest value of 
the energy seen in the simulation decreases. This event 
corresponds to a first visit to a new subtree containing 
states of lower energy, and is - by construction - triggered 
by a record-sized (positive) energy fluctuation. The loga- 
rithmic rate of energy loss a(T) is thus the product of the 
logarithmic rate at which record-sized energy fluctuations 
occur with the average net amount of energy given off in 
a single quake. The logarithmic rate of record-sized en- 
ergy fluctuation is independent of both temperature and 
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FIG. 3: The mean inner Energy E of the tree ensemble plot- 
ted versus system age for different temperatures showing the 
progress of the relaxation process. Note that after some kind 
of startup phase lasting until t ~ 200 the energy shows a 
practically straight decrease at logarithmic time scale. 



time |13[ 123] . The average amount of energy given off 
in a single quake would also be temperature independent 
if the path leading to the new lowest energy state were 
purely exothermal. However, since side branches in the 
tree can trap the walker on his way down, an activated 
contribution can be expected. Accordingly, we expect 
the thermal energy reached at a fixed time to be higher 
the lower the temperature, which is of course a hall mark 
of the non-equilibrium nature of the dynamics. The tem- 
perature dependent offset C is related to the initial stage 
of the relaxation and has no importance for our treat- 
ment. 

According to Q the rate of energy loss te = — dE/dt 
has the form 



, . dE a(T) 



(5) 



which fully agrees with the numerical results shown in 
figure [4] as well as with similar results for microscopic 
model simulations pj [§]• The figure depicts the rate of 
energy loss for selected temperatures (symbols) together 
with fits according to ^ (lines). 

As just discussed, we expect the logarithmic rate of 
energy loss, a(T) to have the form 



a(T) = 5 E + ccxp(-b/T) 



(G) 



where Se is the average contribution to the energy given 
off by paths not involving any energy barriers. The acti- 
vated term involves a barrier which should be comparable 
in size to the smallest barrier present in the system. Fig- 
ure [5] confirms equation ^ for the present model. The 
value Se = 0.195 is the one judged to provide the best nu- 
merical agreement with the data. The parameters b and c 
where estimated by least square fitting. The value of the 
'barrier' parameter b = 0.307 is close to the value of the 
smallest energy barrier present in the model, 6 m ; n = 0.5. 

Figure [6] shows the bandwidth of the Gaussian fluctua- 
tion <7 rcv versus the temperature. The curve is relatively 



FIG. 4: The rate of energy loss te is plotted versus system 
age for different temperatures. The lines have the form te = 
a(T)/t with the constant a as in equations (4| and |5|. To 
avoid clutter, the data set for each T is multiplied by 1, 3, 
9, ... in order of increasing T. A similar but much smaller 
shift of the curves in the same direction is present due to the 
temperature dependence of a. 
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FIG. 5: The logarithmic rate of energy loss a(T) (see |5|), 
shifted by Se, is plotted vs. the inverse temperature. The 
data are fitted to the expression a(T) = Se + cexp(— b/T) 
yielding Is = 0.195, b = 0.307 and c = 0.318. 
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6: The standard deviation cr rcv plotted versus temper- 
is obtained from the Gaussian part of the energy ex- 
;e PDF. 
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featureless and increases with temperature as expected. 
For a classical system (with constant heat capacity) the 
fluctuation bandwidth would be proportional to T. The 
data shown have a slightly faster than linear increase with 
T. 

The results presently obtained, with the possible ex- 
ception of figure |6j very closely mirror the behavior of 
the Ising model with plaquette interactions recently in- 
vestigated by one of the authors [5] . 

V. DISCUSSION AND CONCLUSION 

Thermal hopping on a tree structure provides a simple 
framework to describe relaxation phenomena in complex 

systems [HI [201 HH [211 ESI HZ1 [251 12H1 133 EH 133 EH]- 

The hierarchical model studied in this work is a mod- 
ification of the even simpler LS model |20j . whose two 
elementary energy scales are replaced with a wider spec- 
trum of energy scales. This is physically more realistic, 
and removes unphysical logarithmic oscillations |34j in 
the energy decay. 

The intermittent energy relaxation of this model is 
strikingly similar to that observed at microscopic models 
For the model, the behavior can be understood 
as follows: At any given time, the probability distribu- 
tion is, to a good approximation, supported within a fi- 



nite subtree. A larger subtree must be entered in order 
to lower the hitherto lowest energy. Thus, record-sized 
energy fluctuations trigger, with a certain probability, 
quakes which then lead to the attainment of lower ener- 
gies. Since the records occur at a rate proportional to 
\jt P2J [13l [23] , the rate of quakes is also proportional 
to 1/t and the quantity x t — —a(T) is, modulo a 
constant proportionality factor, the energy given off in a 
single quake. 

Further evidence for the crucial role of record-sized 
fluctuation was provided by an analysis of the Edwards- 
Anderson spin-glass, which was done using two different 
dynamical update rules: thermal hopping [35 and ex- 
tremal optimization |36j . In both cases, it was found 
that a record-sized energy barrier needed to be overcome 
in order to lower the current lowest energy seen so far 
in the simulation. Since the update rules are completely 
different in the two cases, and yet lead to the same re- 
sult, the connection between record-sized energy barriers 
and low energy states is likely to be a true geometrical 
property of complex energy landscapes. 

In a thcrmalizing hierarchical model, record-sized en- 
ergy fluctuations are needed to move from one metastable 
region of configuration space to a different region of lower 
energy. In this paper we have shown that this one prop- 
erty suffices to generate realistic spectra for the intermit- 
tent energy fluctuations. 
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